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Abstract 

In this review paper, we survey the main concepts and some of the recent devel- 
opments in quantum feedback control. For consistency and clarity, essential ideas and 
notations in the theory of open quantum systems and quantum stochastic calculus, as 
well as continuous measurement theory are developed. We give a general description 
of quantum feedback control, set up a coherent model and compare it to open-loop 
designs. Objectives which can be achieved by feedback, such as rapid state prepara- 
tion and purification or entanglement generation are formulated and analyzed, based 
on the relevant literature. The connection between quantum feedback and quantum 
chaos is also described and unravelled which, apart from its theoretical curiosity, can 
shed more light on some of the intrinsic properties of this control paradigm. 
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1 Introduction 



In the 21 st century we see the advent of true quantum technologies such as quantum com- 
puting (39] and quantum metrology [16] which are expected to outperform any conventional 
approach. These fields are rapidly evolving and have created the demand for strategies to 
govern individual quantum systems. Thus, the theory of control of quantum systems has 
gained tremendous interest recently and is already a huge field. Parallel to the theoretical 
advances, the experimental side has also seen a blast, especially due to the swift progress in 
intense and ultrashort laser pulse generation [32] which opens up the prospect to observe and 
manipulate properties of single molecules, solid-state systems or atomic-scale phenomena in 
real-time. 

There have been numerous paradigms developed for different tasks and control objec- 
tives. One of the early ones is open-loop control which relies on the knowledge of the initial 
quantum system and a well-defined control objective to design control fields without consid- 
ering feedback from measurements. This can be done coherently, i.e. we use these control 
fields in a way that does not destroy quantum coherence which was utilized for problems 
e.g. in quantum chemistry. In coherent control in general, the control operations consist 
of unitary transformations. However, some quantum systems may not be controllable using 
only coherent controls. For such uncontrollable quantum systems, it may be possible to 
enhance the capabilities of quantum control by introducing new control strategies where one 
is allowed to destroy coherence of the quantum systems during the control process (incoher- 
ent control). Optimal control techniques such as gradient-free convex optimization can also 
boost the convergence properties and efficiency of open-loop control designs. 

Although open-loop strategies have achieved theoretically and practically significant suc- 
cess, they are quite limited in scope. It was natural to extend the studies to closed-loop 
control which has been investigated in depth in classical control theory and shown to be 
superior in many ways, most notably in reliability and robustness. These are essential in 
quantum control because any practical quantum technology - a quantum computer, for in- 
stance - has to be robust in the presence of noise or uncertainty. In closed-loop control, the 
state information is used in shaping the control mechanism. We may split this paradigm 
into two categories (although other categorizations also exist): adaptive learning control 
and quantum feedback control (QFC). In the former case we have a closed-loop operation 
and each cycle is applied on a new sample. This procedure has gained great success where 
multiple samples are available, e.g. controlling molecules in an ensemble with lasers [51 127]. 

The other concept, quantum feedback control (QFC) includes direct or indirect mea- 
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surements on the state to gain information which can be fed back to achieve the desired 
performance. Classical feedback control is well-understood and has tremendous advantages 
because - in principle - the measurement back-action can be neglected classically, i.e. we 
can acquire full information without disturbing the system. Due to the intrinsically different 
nature of quantum mechanics, most importantly the well-known phenomena of quantum 
state collapse and the unnegligable measurement back-action, QFC faces a great number of 
challenges. Nevertheless, much has been done since the first recognition (see e.g. [3]) of the 
importance of this paradigm and promising results have been obtained. 

The paper is organized as follows. In Section[2j, we overview the most important elements 
of the general framework needed to formulate problems in quantum feedback control such as 
the Markovian master equation, weak and Continuous measurements, stochastic Schrodinger 
and master equations jH |23j [13] . This can be useful for people who are not familiar with 
the formalism of this field and also helps the survey to be self-consistent, self-contained 



and to avoid ambiguities in notation. In Section 3.1 , we give a general description of QFC 



and in Section 3.2 , we set up a coherent control model [20] and outline some theorems 
regarding its capability [H]. Furthermore, in a generalization of this setup, it is convenient 
to compare the results with open-loop control [40J. In Section 3.3 , we briefly introduce how 
quantum feedback can help us to understand quantum chaos better which has found to be 
essential in understanding the transition from quantum to classical [9j [TEl EH ED] . In the 
following section we review some of the tasks which are proven to be efficiently achievable 
such as quantum error correction, rapid state preparation and purification, entanglement 
generation. We start with a simple example: feedback control of a single qubit in a discrete- 
time setting [24] . This clearly illustrates the central concepts. Then we move on to a similar 
task but with a Continuous measurements [24] ; at the end of this section, we also make 
some remarks on recently emerged questions (arbitrary large systems [6], feedback delay 
problem |8]). Entanglement generation is a novel example where quantum feedback is useful 
[52"| I50"[ [22] which is described in Section 3.4.3 A projective measurement-based feedback 
scheme is described in Section 3.4.4 which connects chaos and quantum feedback control 
from a different perspective. This scheme can be used for several purposes such as state 
purification or enhancing entanglement (which has been proven for a two-qubit case ??). 
We present reproduced simulations in some of the cases (Section |3A4l ). 
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2 Background and formalism 



2.1 Quantum mechanics, strong and weak measurements 

In quantum control the systems we want to control are quantum systems, thus described 
by the general framework of quantum mechanics. For closed systems the state is described 
by a unit vector in a Hilbert space H (state space postulate). The time-evolution 
of the state of a closed quantum system is described by a unitary operator (evolution 
postulate). When two physical systems are treated as one combined system, the state space 
of the combined physical system is the tensor product space %i <g> "H 2 of the state spaces 
"Hi, 7^2 of the component subsystems (composition of systems postulate). Quantum 
measurements are described by a set of measurement operators {M m } which act on the 
state space of the system being measured and satisfy Yl m M^Mm = I (the index m refers to 
the measurement outcomes). If the state of the system immediately before the measurement 
is then the probability that we measure m is (?/>|M r ! re M m |-?/>) and the measurement leaves 
the system in ((■^|M J ' n M m |-?/>))~ 1 / 2 • M m \ip) (measurement postulate). 

In many situations we only know a probability distribution about the states in which the 
system can be, i.e. {(\ipk) ,Pk)}k=i,2,... < pk < 1 YlkPk = 1 (the system is in a mixed 
state). In this case, it is convenient to introduce the density operator: p = ^2, k Pk\ipk) {ipk\- 
From construction we know that p is Hermitian, positive and Tr(p) = 1. Also, Tr(p 2 ) = 1 if 
and only if the system is in a pure state and under a U unitary transformation p transforms 
as p — > p' = UpW . 

Let us introduce now another class of measurements which provide only partial informa- 
tion about an observable. We can do this if we choose our measurement operators to be a 
weighted sum of projectors (we will denote their eigenstates as \n)), each on peaked about 
a different value of the observable, i.e. 

M m = ^E e " fc(B ^ )a/4 | n >< n l W 
n 

where M is the normalization factor chosen so that M m satisfy the completeness relation 
Ylm M^Mm = I and we assumed that the eigenvalues of the observable N are n G Z. As an 
example, if apply this measurement to a completely mixed state (so p oc I) and obtain the 
result m, the post-measurement state is 

p' = -Lj2 e ~ k(n ~ m)2/2 \n}(n\ (2) 
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from which we see that the final state is peaked about the eigenvalue m but has a finite 
width given by 1/ \/k. Measurements for which k is large are called strong measurements 
and for which k is small are called weak measurements^^ 123] . 



2.2 Open quantum systems 

The above postulates might be enough to treat closed quantum systems; however, in most 
practical situations we have to deal with open systems (for a deep introduction we refer to 
jl]). On one hand, this is due to the fact that any realistic system is subjected to a coupling 
to a second system (we will use the term environment or bath for the second system if it is 
much larger than the first) in an uncontrollable and non-negligable way. On the other hand, 
even if one can provide and solve a microscopic description for the combined system, most of 
the results would be irrelevant. Open systems are also important when we want to monitor 
(i.e. Continuously measure) a system. Both cases are essential in quantum feedback control. 
We start with a closed system. The Schrodinger equation is 

ij t \m) = H{t)\m) (3) 

where H(t) is the Hamiltonian of the system and we have set ft to 1. It is easy to see that 
for a mixed state ^ implies 

|p(t) = -z[tf(t),p(t)] (4) 

which is called the von Neumann or Liouville - von Neumann equation. This can be written 
in the form 

j t Kt) = mm (5) 

where one can easily notice the analogy with the classical Liouville equation. Here, C is the 
Liouville super-operator (it is a super-operator, since it maps operators to operators). We 
will drop the hats from the operators from now on. Note, that if we work in the interaction 
picture, (|4]) and (|5j) still hold for the interaction density matrix and interaction Hamiltonian 
(which we will denote with a subscript /). We can write Q in an integral form as 

Pl (t) = Pl (t ) - i f [Hr(t'),p(t')]dt' (6) 

We can use this to solve Q perturbatively. 

Formally, it is easy to generalize Q to open systems. Consider the case when the system 
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is in a bath (thus, the Hilbert space of the total system is T-Ltotai = 'Hsystem ® Hbath)- The 
Hamiltonian of the total system can be written H(t) to tai = H system <g> I bath + I S y Stem ® H bath + 
H interaction^)- The density matrix of the system can be obtained by tracing out the bath 
from the density matrix describing the total system (S+B): p s = Tr B (ps+B)- So Q takes 
the form 

j t p s (t) = -iTr B [H(t),p(t)} (7) 

However, in general the dynamics of ps can be rather involved and we have to make assump- 
tions to proceed. Let us assume that at t — the system is uncoupled from the environment, 
i.e. p(0) = ps(0) g) ps where p B represents some reference state of the bath. Then the trans- 
formation from t — to some t > of ps can be written as ps(0) — > ps(t) = V(t)ps(0). We 
introduced V(t) which is a map from the system space to itself and is called a dynamical 
map. It can be shown that these maps represent convex-linear, completely positive and 
trace-preserving quantum operations. If we neglect the memory effects in the reduced sys- 
tem dynamics (justified later) we can show that they also form a semigroup. Under some 
mathematical conditions jl] there exists a linear map (let us call it £) which is the generator 
of the semigroup, so we can write V(t) = exp(Ct). From this we rewrite (|5| as 

j t p s (t) = £ Ps (t) (8) 

which is called the Markovian master equation. It was shown by Lindblad in 1976 that the 
most general form of £ (so that a solution is always a valid density matrix) is (assuming 
that the dimension of the Hilbert space of the total system is N < oo) 



N ' 2 ^ ( 1 i \ 

Cp s = -i[H, p s ] + Yl L kPs L l - 2 L * LkPs ~ 2 PsL * Lk ) 
k=i ^ ' 



(9) 



where the quantities 7^ are non-negative (and can be shown that physically they play the role 
of relaxation rate for the different decay modes of the system), the operators Lk are arbitrary 
operators, called the Lindblad operators, satisfying that L\Lk is bounded (although this 
condition is usually ignored). The first term represents the unitary part of the dynamics and 
the second term is the dissipative part (often denoted as V[ps}). 

It is possible to derive the generator £ assuming various underlying Hamiltonian dynam- 
ics, although several approximations are usually needed. As an example, if we consider a 
weakly coupled system and use the Born-Markov approximation |38| . we obtain the Born- 
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Markov quantum master equation 



d f°° 

j t Ps( t ) = -j o tM#i(0J#i(*-O,M*)®pbK (10) 

It is worth mentioning what physical assumptions we made here. First, we assumed that 
the bath is only negligibly affected by the interaction. Secondly, we said that environmental 
excitations decay over times which are not resolved (in other words, the time scale over which 
the state of the system varies appreciably is large compared to the time scale over which the 
reservoir correlation functions decay). 



2.3 Continuous measurements and stochastic processes 

Here we use the formalism introduced in Section 12.11 to describe Continuous measurements 
and to derive the stochastic Schrdinger equation and the stochastic master equation. The 
reader is referred to [23] for a broader introduction but we closely follow its lines. These are 
the most commonly used equations in quantum feedback control theory. 

Continuous measurement means that we continually extract information from the system 
and it can be obtained by performing a weak measurement in At time steps with the mea- 
surement strength being also proportional to At, then taking the limit At — > 0. Let X be a 
Hermitian operator (i.e. an observable) and for simplicity assume that X has a Continuous 
spectrum (it turns out that the results are valid for any Hermitian operator [23]). Denote 
the eigenstates as \x), so (x\x') = 5(x — x'). Now, in analogy with Q, let us perform a 
measurement described by the operator 

1/4 



M(/i)=^— — ) / e- 2km(x -»>\x}(x\dx (11) 



at every time step At, where M(/z) is a Gaussian-weighted sum of projectors onto the 
eigenstates of X. Choosing the initial state as = J ijj(x)\x)dx the probability density 
P(/x) of the measurement result /i is 



P0*)=Tr[M0*) t |VX^(A*)]= ( 
and the mean value of \x is 



' 1 ' e~ 4kAt ^ Wx)\ 2 dx (12) 



7T / 



oo 

2, 



(fi)= / fiP(fi)dfi= / x\ip(x)\ 2 dx = (X) (13) 
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where we simply plugged in (12) and used jie 4kAt ( x ^ 2 d\i = (4/cAt) 1 l 2 (ix) l l 2 • x from 



where we can also justify our chosen normalization. Now we approximate (12): we replace 
^(x)! 2 by a 5-function centered at (X) = (/i). This can be justified because if At is 
sufficiently small, the Gaussian is much broader than ip{x). After the substitution and 
performing the trivial integral we obtain 

1/2 

P(/i ) „ e -4*A t0M *» 2 (14) 

We can represent fi as a stochastic variable 

AW 

= {x} + vm (15) 

where (AW) = and its variance is Var(AW) = At. AW is called the Wiener increment and 
it is worth stopping here and defining it in a more general fashion. The Wiener process W(t) 
is a Continuous-time stochastic process with three properties: W(0) = 0, W(t) is almost 
surely Continuous and W(t) has independent increments with W{t) — W(s) oc Af(0,t — 
s) V0 < s < t where J\f(m, a 2 ) denotes the normal distribution with expected value m and 
variance a 2 . The condition that it has independent increments means that if < s± < t\ 
and < $2 < t 2 then W(ti) — W(s\) and W{t 2 ) — W(s2) are independent random variables 
and similar condition holds for n increments. It can be shown [12] that at a fixed time t, the 
probability density function of W(t) is 

P[W{t)\ = -^=e- x2/2t (16) 
V znt 

and also the expectation value of W(t) is zero and the variance is t. An important rule 
for the Wiener increment is that when we take the infinitesimal limit (i.e. At — > dt and 
AW -> dW) then 

{dWf = dt (17) 

This is one of the so called ltd rules. The outline of the proof of this statement is as 
follows. We consider the probability density function of (AW) 2 which we obtain by a simple 



transformation of (16). From this we can see that ((AW) 2 } = At and Var((AW / ) 2 ) = 2(At) 2 . 
We split up At into iV intervals and sum of the squares of all the corresponding Wiener 
increments, i.e. (AW n ) 2 . Now if we take the continuum limit, this sum becomes a Gaussian 
random variable (from the central limit theorem) with mean t and variance 2t 2 /N. As 
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iV — > oo, this variance vanishes. So 

N-l 



[ (dW{t')) 2 = lim Y(AW n ) 2 = t= [ dt' 
Jo ^ Jo 



We want this to hold for any interval (0,t), so we must have dt = dW 2 . This also means 
that dW 2 is not a random variable since it has no variance when integrated over any finite 
inverval. 



Now let us examine the equation of motion conditioned upon our measurement ( 11 ). The 
evolution can be computed (using only the postulates) as 



m + At)) OcM(/i)|^(t)> oc e -2fcAt(„ s -X) Ke -2fcA« ^X(4k(X)At + V2kAW)^ t)) (1Q) 

where we simply applied the measurement M(/i) at a time step At and ignored the normal- 



ization and other constant factors. Now expand (19) to first order in At (which means that 



we have to keep second order terms in AW according to the Ito-rule): 

|-0C* + At )) t 1 - 2A;AtX 2 + X(4k(X) At + V2kAW + kX(AW) 2 )} |^(t)) (20) 

Now we take the continuum limit, so At —> dt AW — > dW (AW) 2 — > dt and we have 

\ip(t + At)) oc [1 - (kX 2 - AkX(X))dt + V2kXdW] \ip(t)) (21) 

However, we must be aware of the fact that - for simplicity - we derived this without con- 
sidering the normalization (thus we wrote oc). It is straightforward to take into account the 
normalization and we obtain 



d|V> = [~k(X - (X)Ydt + V2A;(X - (X))dW\ |^(t)) (22) 

where d\ip) = \ip(t + At)) — \ip(t)). This is the well-known stochastic Schrddinger equation 
(SSE), although not in its most general form (e.g. we chose the measurement operator to be 
Hermitian). In terms of the density operator this gives 



dp = -k[X, [X, p]]dt + V2k(Xp + pX- 2(X)p)dW (23) 

which is the stochastic master equation (SME) |3j without the Hamiltonian evolution term. 
The first term in the equation describes the drift towards the measurement axis. The second 
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term describes the update of knowledge of the density matrix conditioned on the measure- 
ment. The measurement record is explicitly 



dW 

dy = (X)dt + -= (24) 
v 8k 



in a time interval dt. \ip(t)) and p(t) define a quantum trajectory. We can write (23) in 



terms of the the measurement record ( 24 ) and we have 



dp = -k[X, [X, p))dt + Ak({X, p} - 2(X)p)(dy - (X)dt) (25) 

where the {} brackets denote the anticommutator. It is worth mentioning that if one per- 
forms the Continuous measurement but throws away the record then the SME becomes 

^ = -k[X,[X,p]] (26) 

which can be obtained by averaging over all the possible records and noting that p and dW 
are statistically independent (so we can throw away the dW term in the SME). 

To have the whole picture, we extend the SME to a more general form, without derivation 
- it would be fairly straightforward from the Markovian master equation ^ - but interpreting 
the terms. The most general form of the SME with Wiener noise and without taking into 
account that the noise sources can also be complex and mutually correlated is 

dp = -i[H, p]dt + ^2v[c n }pdt + y/rj^n[c n }pdW (27) 

n 

where c is an arbitrary operator, T>[c]p = cprf — cp+ prf c) is the dissipation superoperator, 
"H[c]p = cp + pc 1 — (c + c^)p is the measurement superoperator, we allowed n number of 
measurements {output channels) and r] n is the efficiency of the nth detection channel [23||4*8]. 

Let us also introduce the Ito-integral and its transformation properties. We often en- 
counter the following stochastic differential equation: 

< f=HX,)+°(X t )'f (28) 
Wt is a one-dimensional Wiener process. This, however, makes little sense as Wt is not 
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differentiable. We can resolve this problem if we write (28) in an integral form 



X t = X + [ f{X s )ds+ [ a{X s )dW s 
Jo Jo 

or, in analogy with ordinary differential equations 



(29) 



dX t = f(X t )dt + a{X t )dW t 



(30) 



and then define the second integral in (29). There are several possible ways to do it (e.g. 



the Stratonovich form, Ito form), we consider the latter: 



to 



f 8 dW a = lim V f th (W tk+1 - W tk 

k=0 



(31) 



A very important remark is that the Ito integral does not obey the usual Leibniz rule which 
is d(X t Y t ) = X t dY t + Y t dX t , instead it obeys d(X t Y t ) = X t dY t + Y t dX t + dX t dY t . Similarly, 
for an arbitrary function of X t we have g(X t ) = g\X t )dX t + \g"{X t )dX^ . 
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3 Quantum feedback control 



3.1 A general description 



As it was mentioned before, feedback control is an ubiquitous and powerful technique for 
classical systems because - in principle - it is possible to acquire all the information about the 
state of a system with certainty by using sufficiently precise measurements. However, there 
are two fundamental features of quantum systems which have to be taken into account in 
the quantum case. The first one is that non-orthogonal states cannot be distinguished with 
certainty. The second one is that any measurement that gains information about a system 
induces an uncontrollable noise to it. Therefore, one must carefully design the control scheme 
to balance the trade-off between information gain and disturbance. 
QFC can be split up into several sub- 



categories depending on the type of mea- 
surement we use or the way we treat the 
controller. The two main approaches to in- 
formation acquistion are strong (projective) 
measurements and Continuous weak mea- 
surements. The controller can be considered 
classical object - that is, the gained in- 
formation is classical - or quantum system 
which processes -and feeds back - quantum 
information [33J. If we assume, that the con- 
troller is memoryless and we do not consider 
any time delays (so e.g. we can immedi- 
ately feed back the information) then it is 
Markovian feedback control and the result- 
ing evolution of the system is described by 
the Markovian master equation ^ derived 
in Section 12.21 In contrast, we can devide 
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Figure 1: A schematic diagram of quantum 
feedback control, reproduced from 



the whole control process into two steps: first, we estimate some of the dynamical variables 
of the state and use the estimated state to design the control. It is usually desirable to obtain 
the measurement record Continuously, therefore this technique requires real-time solution 
of stochastic differential equations and fast measurements. The dynamical equation of the 
evolution is non-Markovian. Determining the conditioned state of the quantum system from 
classical measurement results is a quantum version of Bayesian reasoning. Classical Bayesian 
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reasoning updates an observers knowledge of a system (as described by a probability dis- 
tribution over its variables) based on new data. For this reason, this feedback paradigm 
is called Bayesian feedback. In [3H] one can find a good comparison of the Markovian and 
Bayesian feedback; the results prove that the latter is never inferior, and is usually superior, 
to the former. However, it would be far more difficult to implement than Markovian feedback 
and it loses its superiority when obvious simplifying approximations are made. 

An interesting, somewhat hybrid approach is the Lyapunov-method which first constructs 
an artificial closed-loop controller, simulates it (e.g. on a computer) and the open-loop 
control law is obtained by the result ("feedback design and open- loop control strategy"). 
The most important aspects of this methodology are: construction of the Lyapunov-function, 
the determination of the control law and the analysis of the asymptotic convergence. For 
example, if our desired final state is \ip)t, we can choose V(t) = |(1 — |(i/>t||V>)| 2 ) as a 
Lyapunov-function and construct the control law to guarantee that 4:V(t) < 0. In this 
paper, we do not consider this method further. 

3.2 An all-optical, coherent model and comparison to open-loop 
control 

In quantum optics it is a common scenario that the system to be controlled is brought in 
weak interaction with an external probe field which is subsequently detected [16]. Here 
we consider a system which is an ensemble of atomic spins interacting dispersively with 
an optical probe which is subjected to homodyne detection. This is an illustrative set-up 
in several aspects and was experimentally implemented [14] and theoretically analized for 
feedback control[20, 19] . As the detailed derivation from first principles would abundantly 
exceed the limit of this paper, the stress will be on describing the physical model and key 
assumptions, rather than the technicalities needed, to obtain the the SME and other main 
results, which we can further analize and compare it to open-loop control. 

We put the atomic spin ensemble in a leaky single-mode cavity and take the problem to 
be one-dimensional (which can be justified if we consider that most of the light is scattered 
forward). The strong driving field is treated semiclassically and polarized light is assumed. 
The leaky single-mode cavity description also allows us to treat the interaction between the 
ensemble and the field with a single frequency, which is chosen to be the laser frequency Uq. 
Spontanious emission into the eliminated modes can be added to the model phenomenolog- 
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ically. In this model the total Hamiltonian can be written as 



H = Ha + Ho + Hcf + Hac + H$e (32) 

where Ha is the atomic Hamiltonian (which can be quite involved, depending on the structure 
of the atoms in the ensemble), Hp is the interaction Hamiltonian of the cavity mode, Hcf 
is the interaction Hamiltonian between the cavity mode and the external field, given by 

POO 

H CF = / k(w) {ia ] (uj)be l{ ^ o)t + ia t (w)6 t e^ w+w °^ + h.c) du (33) 
Jo 

where a(u), a){ui) are the annihilators/creators for the electric field (they correspond to plane 
wave modes in the ^-direction) and b(t),b'(t) are the cavity mode annihilators/creators 
with b(t) = be~ luJot , k(uj) is the mode function. The remaining Hamiltonians are: Hac 
is the ensemble-cavity mode interaction Hamiltonian and H$e corresponds to spontanious 
emission. Note that the quadratures a(u) + a (a;)' and ia(u) — ia(ouy are Gaussian random 
variables. We will call 

i r+oc 

a{u)e- iui 

-oo 

quantum white noise as - in the vacuum state - its quadratures have zero mean and delta- 



i r+oo 

a{t) = -= \ a{u)e- wt duj (34) 

V27T J-r 



correlated covariance. Also note, however, that the whole evolution described by (32) is not 
driven by white noise (i.e. with a fast varying k,(u)). We have to make a key assumption to 
obtain this, namely that the cavity is weakly coupled to the external field. We can define 

/•oo 

A t = a(t)dt (35) 
Jo 



which is a Wiener process and we can define integrals J X s dA s as they were defined in (31 ). 

Now we introduce a model for the atomic ensemble. Consider N atoms with a degenerate 
two-level ground state. Assume also that all the atomic transitions are far detuned from the 
cavity resonance; F z will denote the collective dipole moment (so it is a spin-N/2 angular 
momentum operator). Thus, Hac = X^zb^b where x is the coupling strength and Ha = 
AF Z + u(t)F y where A is the atomic detuning and u(t) is the strength of the magnetic field 
in the ^/-direction (which is under our control). If we do not consider feedback control, the 
open-loop evolution can be written as 

?& = -i[AF M + v(t)F v ,p(t)) (36) 
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We can add the decoherence term due to spontanious emission in a phenomenological way 
as follows. Introduce another field E with annihilators c{uS) called the side channel. This 
will be left unobserved. So H SE = —d(t)E(0,t) where d(t) is the atomic dipole operator. 
Because the atoms are coupled directly to E(0, t), we can write d(t) = ae~ tu)dt + a^e %Wdt where 



cr is the atomic decay operator and Ud is the dipole rotation frequency. This modifies (36) 
with an extra term: 

P@. = - t [AF z + u(t)F y , p(t)) + 7 V[a)p(t) (37) 
where 7 is the decoherence strength and T>[a]p = apa^ — Ua^ap + pa^a) is the dissipative 



superoperator, just as defined in (27) 



Now we introduce our measurement and feedback procedure. Homodyne detection is 
a powerful technique in practical detection of light beams. This involves another strong, 
coherent signal (called the local oscillator which, in the homodyne case, has the same fre- 
quency as that of the detected signal) which is mixed with the original signal. This can 
help to eliminate the initial fluctuations of the laser and allows us to detect a quadrature 
of the system, e.g. a t + a\ after the field has interacted with the spins; thus, we observe 
the photocurrent I(t) = U}(at + a\)Ut where Ut is the evolution of the whole system. It is 
useful to introduce the integral form of I(t), the integrated photocurrent Y t which is then 
Y t = ll}(A t + A\)U t . Using this we have to solve the quantum filtering problem. That 
is, given an atomic observable X, we want to find the best estimate of X given the prior 
observations, formally K[U}XUt\Y s < t }. This problem can be solved after deriving the whole 
evolution of the system and by using properties of the conditional expectation, tricks form 



real analysis and the Ito rules. In this model the SME derived in (27) takes the form [20] : 



dp t = -iu{t)[F y , p t }dt - is[F z , p t ]dt + MV[F z }p t dt + ^/M^H{F z }p t dW t (38) 

where s is a parameter which depends on the experimental setup (such as x), 6 (0, 1] is 
the detection efficiency, M is the effective interaction strength which is a function of x an d 
the drive amplitude (this quantity manifests itself in the Hamiltonian of the interaction of 
the cavity) and, as a reminder, T-L[F z ]p = p = F z p + pF\ — (F z + F})p and we defined dW t 
(innovation process) as 

dW t = dr t -2y/Mri(F g )dt (39) 



and it can be shown that it is in fact a Wiener process (the idea is the same as in Section [2^3 ). 
It contains white noise terms and also the new information provided by the measurement. 
Just as in the open-loop case, we can add the decoherence term describing the spontanious 
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emission and we have 



dp t 



-iu(t)[Fy,Pt\dt - is[F z ,pt]dt + MV[F z ]p t dt + jV[a]p t + ^M^H[F z ]p t dW t (40) 



With equations (36), (37), (38) and (40) we obtained the open-loop and feedback evolutions 



in the described model, without and with the decoherence term, respectively. Figure [2] 
shows the control setup. 

Magnetic coil 



probe laser ■ cavity with 
I spin ensemble 



Homodyne 
detector 



u(t) 



dY t dW t 



Filtering <_ 



Control law 



Figure 2: The feedback setup for the spin ensemble. The system is in a leaky single-mode 
cavity and it interacts with a laser field. After the interaction the beam is measured by a 
homodyne detector and processed. This drives the filtering process which produces the best 
mean square estimate of the system state. This is used directly to design the control law. 
The feedback is achived by applying magnetic field. 



Now we have to define a control objective. This can be, for example, state preparation. 
Suppose that the initial state of the system is p — Y^i=iViPi- The objective is to prepare a 
desired eigenstate \ipf) of F z with high fidelity. 

Consider the case without decoherence. We can use a simple argument to show that 
measurement-based feedback is superior to open-loop in the sense of dealing with uncertain- 
ties of the initial state. Note that (36) does not change the von Neumann entropy defined 
by 

S{p) = -Tr(plog(>)) 

This entropy is zero if and only if the state is pure and is invariant under unitary evolution. 
This means that we cannot prepare the target state - which is pure so has zero entropy 
- from an arbitrary mixed state regardless how we choose u(t) and possibly A with the 
OLC evolution (36). In the MFC case, however, it has been proved (in a rather involved 
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but rigorous way with explicit construction of the control law, see [37]) that we can always 



construct u(t) such that it globally stabilizes (38) around pf as t — > oo. Of course, if we only 



consider the measurement effect (i.e. there is no control, u(t) = 0), the evolution will project 
the state onto one of the eigenstates of F z and projective measurements always increase the 
entropy. 

Now consider the case with the decoherence term. It is mathematically convenient to 
choose a specific representation, e.g. denote |0) = (1, 0) T and |1) = (0, 1) T the two eigenvec- 
tors of F z and also we can use the Bloch representation for p with Bloch coordinates x, y, z. 



We can expand out the OLC and MFC evolution equations (37) and (40) in terms of x t , yt, z t 
where the subscript t denotes "target". We choose = |1) so Zf = — 1. The fidelity is 
given by F(p, \ipj)) = ^(1 — z). Now, for the OLC case, one can prove that for arbitrary 



initial state and arbitrary admissible control law (such that the equation (37) has a unique 
solution) we have 

limsupZf > 

t— >OD 

which means that the fidelity is upper bounded with Ft < 0.5. So we cannot always prepare 
the target state with high fidelity regardless our choice of u(t) and A. 

In the MFC case one can show that the fidelity is bounded by the quantity 



F t < liminf 

t— ¥00 



2(1 + 1) i Mr] 



so there is a quite complex connection between the efficiency of the MFC model and the 
parameters (decoherence strength, effective interaction strength, detection efficiency). How- 
ever, this cannot tell us if liminf F t > 0.5 is always true or not. The simulations in 
[4"T] suggest that it is (at least for a large class of initial states and using an appropriate 
controller setup) true and the authors conclude that MFC is superior to the OLC in dealing 
with uncertainties. 

We can extend the analysis by considering a more general form of the SME [40J: 

dp = -i[H + u(t)H b , p t )dt + MV[L] Pt dt + ^MU\L\pdW t (41) 

where L is an arbitrary system operator (the measurement channel), H is the effective 
Hamiltonian and is the control channel of the system. This can be easily obtained from 



(27) by taking only one measurement channel (and call the system operator L), setting the 



Hamiltonian H = H + u(t)Ht> and introducing the effective interaction strength M or also 
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from (38) by setting H Q = Hf, = F y L = F z . The corresponding OLC evolution is clearly 

^ = -i[H + u(t)H b ,p t ] + MV[L]p t (42) 

We assume that Hq and L are non-degenerate. We have to cases depending on the relation- 
ship between the system operator L and the Hamiltonian H , namely if they commute or 
not. 

Theorem 1. In the OLC case with [Hq,L] = it is not possible to prepare any desired 
eigenstate of H from any mixed initial state regardless how we choose Hb,u(t). 

This can be proved in a straighforward fashion by proving that < so we cannot 



increase the purity of the state with (42). 



Theorem 2. In the OLC case with [H , L] ^ then 3 an eigenstate \ip) of H for which the 
fidelity with p t is upper bounded, so 

limsupF(p 4 , |-0}) < 6 < 1 

and it is possible to construct the upper bound 5 which is a function of and L [40J. 
For the MFC case let us define asymptotic reachability. 

Definition 1. An eigenstate of H is asymptotic reachable under L if 3 Hi,,u(t) such 



that for an arbitrary initial state po there exists a unique solution of (41), denoted by o, 
which converges to if) in probability, formally: 

HmFK|V)M) = l 
We can state now the following theorem. 



Theorem 3. Consider (4-1) with H , L being Hermitian and rj £ (0,1) (imperfect detection 
efficiency) . Then every eigenstate of Hq is asymptotic reachable under L if and only if 
[H o ,L} = 0. 

The proof of this is rather technical and can be found in j4D] (the proof is also based 
on the results in [IH]). We can conclude that if we choose the measurement channel L 
appropriately, we can reach every eigenstate of Ho asymptotically with the MFC model, 
while from Theorem [TJ we saw that in the OLC model it is not the case. In this sense, 
the measurement-based feedback control is superior to open-loop control in the generalized 
model as well. 
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3.3 Quantum feedback and chaos 

"Anyone who uses words the "quantum" and "chaos" in the same sentence 
should be hung by his thumbs on a tree in the park behind the Niels Bohr 
Institute." 

Joseph Ford 

The unravelling of the connection between chaos and quantum mechanics - despite the great 
interest it had gained - has been proven to be a puzzling question and was a subject to 
heated debates among physicists and mathematicians. As a result, there is an extensive 
literature on it (for a good summary, see e.g. [H]) and the review of it would greatly exceed 
the framework if this paper and would not be relevant. Rather, we focus on the recent 
development of the topic which shows that Continuous measurements and feedback plays an 
important role in understanding the subject. 

The first studies related to classical chaos date back as long as the end of the 19th century 
(Poincare, 1892) and chaotic systems can be characterized by their exponential sensitivity 
to the initial conditions. This sensitivity can be measured by the Lyapunov exponent which 
yields the asymptotic rate of exponential divergence of two trajectories which start from 
neighbouring points in the phase space. If the (maximal) Lyapunov exponent is positive for 
a system, it is said to be chaotic. In closed quantum systems, however, the time evolution is 
unitary which does not allow the exponential divergence of the trajectories (in Hilbert space). 
In other words, the evolution of a closed quantum system is necessarily quasiperiodic (this 
can be directly shown from the quantum Liouville equation, for example). Quantum chaos 
traditionally meant the study of quantized versions of classical chaotic systems. 

The paradox is apparent: how can classical mechanics emerge from quantum mechanics 
in an appropriate macroscopic limit if the former manifestly exhibits the above mentioned 
property but the latter does not? One - and the dominant - way to resolve this is the 
observation of the fact that every experimental setup involves measurement, therefore open 
quantum systems [T7] . 

It was first noted in [31] by Lloyd and Slotine that the nonlinear dynamics induced by 
weak quantum feedback could be used to create a novel form of quantum chaos. In this 
context, weak quantum feedback means that one performs a collective measurement on a 
large number of identical systems, thus obtains the average value of an observable while 
only slightly disturbing the individual systems, and then feed back this information. This 
form of weak measurement can be realized in NMR for example, where it is possible to 
monitor the induction field produced by a large number of precessing spins which gives 
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the average value of their magnetization along a given axis but only slightly disturbs the 
spins. In a general picture, it formally means the following. Suppose we have N identical, 
noninteracting quantum systems, each characterized by p. Using for example the POVM 



described in Section 2.1 , it is possible to perform a measurement on p® N which determines 
the single-system reduced density matrix p to some degree of accuracy 5 while disturbing it by 
e with the property that if iV — > oo then 5, e — >■ 0. Now if we feed back this information (i.e. 
apply to each system a unitary transformation U(p)) then the single-system density operator 
will be governed by the equation p' = U(p)pU^(p) where it is crucial to note that U(p) can 
be any (possibly nonlinear) function of p. Taking the Continuous limit this immediately 
leads to 

f t =-t[H(p),p] 

where H(p) is the Hamiltonian corresponding to U (p). The possible forms of U(p) and non- 
linear quantum transformations in general were analized in [H] . Besides other applications, 
such as, for example, creating Schrdinger's cats, i.e. quantum systems that exist in super- 
positions of two quasiclassical states, systems that obey nonlinear equations could be used 
to create true quantum chaos; this is because the SSE need not preserve the distances of the 
trajectories. 

A further analysis on how chaos can emerge from the SME even far from the classical 
limit was done in (18] by Habib et al. They choose the observable to be the the position 



operator x, thus the SME takes the form of (25) with X = x and consider the Duffing 
oscillator (single particle in a double-well potential, with sinusoidal driving) which has a 
Hamiltonian H = p 2 /2m + Bx A — Ax 2 + Axcos(ut) where p is the momentum operator, 
A, B, A are parameters which determine the potential and the strength of the driving force. 
Let us label the possible realizations of the noise process dW by s. Introduce the divergence 
between a fiducial trajectory and another ("shadow") trajectory infinitesimally close to it: 
A(t) = | (x(t) fid) — (x(t))\. We can now define the observatinally relevant Lyapunov exponent 
by 

A = lim lim f ln(As(t)) ^| ee lim \ s (t) (43) 

t-¥oo A s (0)-X) \ t ) t^oc 

which is reasonable because we are interested in the sensitivity of the system to changes in 
the initial conditions and not in the changes in the noise realizations so we keep that fixed. 
By simulations using paralel supercomputers they find that, after a 1/t behaviour, X s (t) 
converges to a positive, finite value and this value is greater if the measurement strength k 
is greater. From these we can conclude that there exists a purely quantum regime which 
evolves chaotically with a positive, finite Lyapunov exponent. 
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In Section 3.4.4 another kind of chaos is introduced which emerges from the conditional 
dynamics of qubits using a specific, selective protocol which can be also useful to perform 
control tasks. We see chaotic behaviour directly in the Hilbert-space and also in the en- 
tanglement in the multiqubit case. At the end of that section one can find a summary of 
feedback-induced chaos. 



3.4 Control tasks for quantum feedback control 

In the following, we review some tasks which can be impleneted by QFC and - where relevant 
- compare their efficiency to other schemes. 

3.4.1 Stabilizing a qubit against noise using discrete time feedback and com- 
parison with classically motivated schemes 

Consider the following task: we prepare a qubit in one of two non-orthogonal states and 
\tp 2 ) with overlap (ipi\ip2) = cos6> < 6 < 7r/2, for example 

= cos(0/2)|+> + sin(0/2)|-) |^ 2 ) = cos(0/2)|+) - sin(0/2)|-) 

where |±) = (|0) ± |1))/a/2. In the Bloch representation [39J this means that the two states 
lie in the x — z plane rotated by about the z-axis. Consider the following noise: 



£ P [p] = p{p z po z ) + (1 -p)p 



(44) 



where a z = |0)(0| — |1)(1| is the well-known Pauli operator and < p < 0.5. This is called 
a dephasing noise [39]: with probability p it applies the phase flip a z and with probability 
(1 — p) it leaves the system unaltered. The dephasing noise has an effect of decreasing the 
x-component of the Bloch vector. The task of stabilizing a qubit against this noise was 
considered in [21] and has recently been investigated experimentally in [15] with a photonic 
polarization qubit. We want to find the quantum operation C which corrects the state after 
the noise has been applied and maximizes the average fidelity between the input state and 
the corrected state, i.e. 



max 
c 



i=l 



(45) 



where C has to be a CPTP (completely positive and trace-preserving) map. 

Now consider the first strategy: "do nothing" . We will see that in some cases this trivial 



strategy can be quite efficient. If we calculate the sum in (45) with C being the identity, the 
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average fidelity we get is 

Fi = l-pcos 2 fl (46) 

which is plotted on Figure [3} a. 

Now consider another - based on a classical concept - strategy: "discriminate and pre- 
pare". This means that we try to distinguish the outcoming state with a projective measure- 
ment and then prepare the state based on this result. This is a classical concept because we 
try to gain as much information from system as we can. The optimal projective measurement 
(in terms of the average probability of success) we can do succeeds with P = |(1 + sin#) 
(Helstrom's measurement), independent of the noise strength p. Now we have to choose our 
states which will be prepared after the measurement. If we say that we prepare if the 

measurement result is {1,2}, this yields an average fidelity of 

F 2 = 1 - i(sin 2 #-sin 3 #) (47) 

However, it can be shown [21] that we can obtain a better average fidelity if we prepare the 
states 

. . [l sin 2 fl . . [l sin 2 # . . 

V A 2v sin v + cos 2 v y L 2v sm V + cos 2 v 

i.e. we prepare \<fi+) if we measured and we prepare if we measured l^)- This 
gives an average fidelity of 

F 3 = - + ^Vsin^ + cos 2 ^ > F 2 V p,9 (48) 

which is plotted on Figure |3}b. Its optimality can be shown using convex optimazation. In 
some regions (for example when p is small) this scheme is outperformed by the "do nothing" 
scheme. Note that this is also a feedback scheme as our choice of state preparation depends 
on the measurement result. We say it is classical, however, because the idea is based on a 
classical concept, i.e. acquire as much information about the system as possible. 

Now we set up a feedback control scheme with weak, non-destructive measurements. 
First we define our measurement operators as E 01 = Mq -^Mq^ where 

M = cos(x/2)|+i)(+i|+sin(x/2)| M x = sin(x/2)| + + cos(x/2)| - 



where | ± i) = (|0) ± i|l))/v 2 (the eigenstates of a y = i|l)(0| — i|0)(l|). This measurement 
can be implemented by using an ancillary qubit, a projective measurement and an entangling 
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gate, x is a parameter which describes the strength of the measurement: for \ = 7r/2 the 
operator become the identity operators, for x — we get a projective measurement. Once 
we performed the measrurement, we apply an other operation based on the result (note that 
this is a feedback procedure): 



3, = e " iW2 = \ L (49) 




We choose the angle to be r] if we obtain from the measurement and — rj if we obtain 1. It 
can be shown that the procedure is optimal if we choose (21] 

r/ = tan _1 [((l -2p)cos^tanx) _1 ] (50) 

with < rj < 7r/2. So our correction operation altogether takes the form 

C[p] = (Z +v M )p(Z +v M o y + {Z^MMZ-nMj (51) 

and the average fidelity we get is 



1 + (52) 

which is plotted on Figure |3jc. The scheme desires some interpretation. First note that the 



dephasing noise (44) can be viewed as a rotation of the Bloch vector of the state by ±a 
(with equal probability and a being determined by p) around the z-axis. Our strategy is to 
have a measurement which determines the sign of a; also, we want to adjust its strength so 
we can vary the trade-off between information gain and back-action effect. Then we apply a 
feedback: we choose this to be a unitary operation which rotates it back to the desired axis 
based on the measurement result. 

Figure |4} shows the difference between the quantum feedback scheme and the other - 
motivated by classical control - schemes in the average fidelities, i.e. 

F(p,6) = F 4 {p,e)-max(F 1 (p,9),F 3 (p,e)) (53) 

It is apparent that F(p, 6) > V p, 9 so the quantum feedback scheme always outperforms 
all the other schemes. It can also be shown - using the same technique as in the previous 
case - that for this task our feedback procedure is optimal. 
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a) 



b) 



c) 



Figure 3: Visualization of the fidelity functions (46) ("do nothing" scheme), (48) ("discrim- 
inate and prepare" scheme) and (52) ("quantum feedback" scheme). 




(a) 3D plot 



0.1 

(b) Contour plot 



Figure 4: Visualization of (53). The non-destructive measurement-based feedback scheme 



outperforms the other schemes in the achieved average fidelity around 0.05 < p < 0.3 0.3 < 
6 < 1 and it never underperforms them. The best result is at p 0.115 9 ~ 0.715 with 
F = 0.026. 



3.4.2 Rapid state purification with Continuous weak measurements 

The following problem is very similar to the previous: the purification of a qubit system 
in the fastest time. However, we can make use of what we have set up in Section [2} and 
perform Continuous measurements to speed up the rate of purification. There are several 
papers which are concerned about feedback control of two-state quantum systems [TUJ US] , 
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specifically this in [24] . The Continuous measurement will be performed on the ^-component 
of the spin- 1/2 particle (so a z represents the observable) and we will use the Bloch represen- 



tation with Bloch vector Y . With these the SME l23h in terms of the Bloch 

components becomes 



da x = -(Akdt + a z V8kdW)a x da y = -(Akdt + a z V8kdW)a y da z = (1 - a 2 )v8kdW (54) 

from where we can see that - not surprisingly, as the measurement marks the z-direction - 
the relation between a x and a y is a constant of motion (the initial angle in the x — y plane, 



$ = arct an (a x /a y ) is constant). Defining A = ^a 2 + a 2 y we can reduce (54) to 



dA = -(Akdt + a z V8kdW)A da z = (1 - a 2 z )V8kdW (55) 

We define the impurity of the system as p(p) = 1 — Tr(p 2 ) = |(1 — A 2 — a 2 z ). This is in 
general not a good measure of mixedness. Nonetheless, it has a simple analytical form and 
it is equal to the von Neumann entropy in the limit of high purity. It is possible to obtain 
the evolution of p from the SME using the linear quantum trajectory formulation (this is an 



equivalent formulation of the SME in which the equations (55) become linear [25] ) and the 
solution is 

e -4kt p+oo p -x 2 /2t 



p(t) = —= \ ^^dx (56) 

V8ntJ-oD cosh(V8A;x) 

which must be solved numerically. However, we can approximate this in the long time 
limit (noting that if t is large than the integral does not depend on t and using the Taylor 
expansion) and we have 

p(t) oc t-^V 4 ^ (57) 

and in the short time limit p(t) decays exponentially with rate 4k. So if we do not consider 
quantum feedback, the only way to speed up the reduction of the impurity is to increase the 
measurement strength k. 

The motivation to introduce a unitary operation during the measurement is the same as 



in Section 3.4.1 One can calculate that the evolution of the length squared of the Bloch 
vector: 



d\a\ 2 = dA 2 + da 2 z = (1 - a 2 z )(A 2 - (1 + a 2 z ))8kdt + a z ((l - a 2 z ) - A 2 )V8kdW (58) 

and it is apparent that the best increase we can achieve is when a z = so the Bloch 
vector lies in the x — y plane. So, if we apply another Hamiltonian (for a time period t) 
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H = /i(cos($)cr a; — sin($)o" y ), which generates a rotation of the Bloch vector by an angle 
a = 2 fit towards or away from the x — y plane while maintaining we can increase our 
efficiency We can note two important things. The first one is that it is a (real-time) feedback 
procedure as we adjust the extra Hamiltonian at each t depending on the measurement result. 
Secondly that to achieve the best efficiency, we must choose the angle such that it exactly 
cancels the stochastic evolution which kicks out the Bloch vector from the x — y plane; this, 
however, leads to the choice of ji(t)dt = \/8kA~ 1 dW which may require an arbitrary large 
Hamiltonian resource. 

It is possible to solve the equation of motion and we obtain a simple result 

? = De- m (59) 
dt v ; 

from where it is easy to see if we choose a very small target impurity (so t is large), the time 
needed to achieve the target in the first case (which we can call classical as it is based on a 
classical idea) and in the quantum feedback case has a ratio of 

— — > I (60) 
td 2 

So it is possible to achieve a speed-up factor of 2, in the limit when the measurement time 
is large compared to the measurement rate, with the help of the feedback scheme. This 
also allows us to perform state preparation: when the desired purity is achived, we apply a 
unitary on the system to rotate it to the desired target state. This is possible because we 
know that the Bloch vector stayed unbiased with respect to the measurement basis. The 
speed-up factor is a theoretical upper bound and can be less if we put constraints on the 
Hamiltonian. This latter case is qualitatively analyzed in [21]. 

It was proved rigorously in [47] that this is indeed an optimal feedback procedure for the 
task, using Bellman equations and verification theorems. Also, it has been proven in general 
that in the optimal feedback control regime, it is always preferable to choose the basis of the 
measurement not to commute with the system density matrix [26J. The whole procedure 
was extended to the two-qubit case, where one is allowed to (weakly) measure only one of 
the qubits (say the first) [21]. One might expect that the best way to purify the second qubit 
is to apply the optimal protocol to the first one; this, however, is not true and was falsified 
by a counter-example. 

One can naturally ask the question: how does this speed-up change if the system is 
arbitrary in size? This was considered in [6] and it was proven that for an observable with N 
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distinct, equally spaced eigenvalues the scheme can boost the rate of purification by at least 
a factor of |(JV + 1) (assuming again infinitely large Hamiltonian resource). This generalized 
problem is significantly more involved than the qubit case and it is an open question whether 
the feedback procedure which achieves this performance is optimal or not. 

There is another important remark. In a realistic setup we always have to consider the 
possible sources of delays which can affect the whole feedback loop. The total effective 
feedback delay is the sum of delays in the loop as the reciprocal detector bandwidth, the 
time needed to perform the filtering and control calculations, response time of the actuator 
(e.g. laser) and the electronic delays between the devices. The aforementioned feedback 
schemes can only work well if the dynamical timescale of the system is large compared to the 
effective feedback delay. Despite some remarkable developments of the devices (responsive 
lasers, electro-optic modulators), it is still not the case; [7] analyses the protocol when 
imperfections in the controls are introduced. They find that delays in the feedback loop 
have the most effect and for systems with slow dynamics, inefficient detection causes the 
biggest error. This was also the motivation for a recently proposed idea [8] where the 
feedback procedure is replaced by an open-loop design together with a quantum filtering. 
The open-loop control is applied for some time (which time period is significantly longer than 
the dynamical timescale of the system) and the quantum filtering can run parallel or offline 
(depending on the control objective). The scheme is proven to be comparable in efficiency 
in several tasks (rapid measurement and purification, for instance) and much less sensitive 
to the delays caused by the limits of technology. 

3.4.3 Entanglement generation 

"Entanglement is iron to the classical world's bronze age." 

I.L. Chuang 

Quantum entanglement is a central concept in quantum mechanics and has many appli- 
cations in quantum information theory and quantum computation. With the aid of entangle- 
ment, otherwise impossible tasks may be achieved, for example in quantum communication, 
and it is also believed to be vital to the functioning of a quantum computer. There has been 
a rapid development of devices that can produce entanglement which often rely on highly 
controlled interactions. These can be based on trapped ions (see e.g. [H] where the authors 
report the creation of Greenberger-Horne-Zeilinger states with up to 14 qubits) or spatial 
confinement of the photons with strong atom-field coupling in a cavity, for instance. 



28 



Applying feedback control schemes to this task was found to be useful in many cases. 
In fact, entanglement protection or generation is one of the most attractive applications of 
quantum feedback. There are a number of studies which have demonstrated that a feed- 
back controller can effectively help the distribution of entanglement in a quantum network. 
Mancini and Wiseman [35J showed that direct feedback can be used to enhance the corre- 
lation of two coupled bosonic modes. The optimal measurement turns out to be nonlocal 
homodyne measurement in this case. Yanagisawa [H2] presented a deterministic scheme of 
entanglement generation at the single-photon level between spatially separated cavities using 
quantum non-demolition measurement and an estimation-based feedback controller. Follow- 
ing these advances, in [50] Petersen et al. described a method to avoid entanglement sudden 
death in a quantum network with measurement-based feedback control. Entanglement sud- 
den death means that entanglement completely disappears in a finite time, in which case 
conventional techniques - e.g. entanglement distillation - cannot assist. They consider a re- 
alistic scenario (the quantum channel is in contact with the environment and the homodyne 
detector has a finite bandwith) with a linear Continuous-variable cavity model. The cavities 
are spatially separated and the interaction is simply mediated by an optical field, in contrast 
to [35], where the bosonic modes interact through an optical nonlinearity. 

Here, we review the control of entanglement generation between two qubits using Con- 
tinuous weak measurements and local feedback in more detail. This was considered in [22] 
and, as we will see, it is an application of Jacobs' protocol (a quite tricky application, we 
might add) described in the previous section, so its formalism fits well in the line (see also 
[5T] for a more general discussion and useful introduction). Note also that the two qubit 
itself is a fundamental element of highly entangled states: in quantum computing, all the 
(unitary) entangle operations on many spins can be implemented by compositions of those 
on the two qubit which is referred to as the universality of quantum circuits. 

Consider the density matrix p of the two qubits which evolves according to the SME 



given in (23). Specifically, we consider the observable to be y = o z <g> a z , so the system 



evolves according to 

dp = -k[(a z <g> a z ), [(a z <g> a z ),p]]dt + V2k((a z <g> a z )p + p(a z <g> a z ) - 2(a z <g> a z )p)dW (61) 

We want to quantify the entanglement of the system. For this, it is useful to expand the 
density operator in the Pauli basis (also called as the Fano form). For two qubits it takes 
the form 

P = - ^ r i3 a i ® a 3 ( 62 ) 
i,j={LX,Y,Z} 
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and the coefficients r^- can be found as = Tr(<jj ®<jjp). From the normalization condition 
we also know that rjj = 1. It is possible to quantify the entanglement between the qubits 
using R 2 = J2ij r ij- A pure Bell-state (maximally entangled state) has R 2 = 3; if R 2 = 
then there is no classical correlation of the two qubits. R 2 < 1 for a product state and for 
a mixed state, increasing R 2 leads to an increase in both purity and entanglement. R 2 is 
also invariant under single qubit rotations. These equations provide the basis if one wishes 
to perform numerical simulations on this problem; in the following, however, we only focus 
on the main ideas rather than technical calculations. 

Let us introduce the concept of decoherence-free subspace (DFS). A DFS is a subspace 
of the Hilbert space of the system that is invariant to non-unitary dynamics, i.e. it remains 
unaffected by the interaction of the system and its environment. This was first introduced in 
a quantum information theory context as these subspaces prevent destructive environmental 
interactions by isolating quantum information. What are the conditions for the DFS to 
exist? There are several possible formulations in which we can answer this question, e.g. 
in the Hamiltonian formulation, operator-sum representation formulation or the semigroup 
formulation. Here we give a description using tha latter one (as all the equations were already 
set up in the paper). Consider the Lindblad form of the Markovian master equation given 
in (|9]). The dissipative part determines whether the dynamics of a quantum system will be 
unitary or not; in particular, when T>[p] = 0, the dynamics will be decoherence-free. Let 
{\j)}f=i span i-Ls C %s where Hg is the Hilbert space of the system. Under the assumptions 
that the parameters jk are not fine tuned and there is no dependence on the initial conditions 
of the initial state of the system, a necessary and sufficient condition to be a DFS is that 
all basis states \j) are degenerate eigenstates of the error generators (Lindbald operators). 
In our case we have two decoherence-free subspaces, given by D + = Span{|00), |11)} and 
D- = Span{|01), |10)} which can be found by observing that the measurement operator 
y = o z <8> o z has two degenerate eigenvalues ±1. One can check that once p is restricted 



to the DFS then dp = according to the SME (61), so the measurement does not extract 
any useful information. Note, however, that it is easy to rotate the system out of the DFS 
by applying Hadamard gates locally to the qubits and this is an invertible operation. This 
means that it is possible to turn on and off the entanglement production procedure without 
turning on and off the measurement device which has practical advantages. 

Now comes the essential idea. First we want to drive the system to the DFS, in which 
case the system will be in a classically correlated state. Once in the DFS, the system is 
driven towards the maximally entangled Bell state. This can be done by using only local 
unitary operations and the measurement of o z <g> cr z , however, our goal is to make use of 
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Jacobs' protocol. Let us introduce two encoded qubits: the first will represent the extent to 
which information is found within the two DFS. If it is in the |0), |1) state then the system is 
confined to D_, D + , respectively. The second qubit contains the information encoded within 
the DFS. Physical operations can be split into two categories: the ones which commute with 
o z ®o z and the ones which do not. The former operations will only affect the second encoded 
qubit (as these operations leave the system inside the DFS) and the latter will only affect 
the first encoded qubit. The basic idea is that we apply Jacobs' protocol to the encoded 
qubits. If we rapidly purify the first one, it means that we rapidly forced the system into 
the DFS. Then we apply the same protocol to the second encoded qubit. This procedure 
can be implemented and purifying the second encoded qubit along a specific axis generates 
entanglement in the physical system [22]. Note that the fastest rate of purification does not 
necessarily provide the fastest rate of entanglement generation. 

The protocol described in the next section can also be used to provide entanglement 
generation. 



3.4.4 Projective measurement-based feedback on qubit systems and the emer- 
gence of complex chaos 

In the context of quantum computation and quantum information, conditional dynamics of 



qubit systems have gained considerable amount of attantion, as we saw in Section 3.4.1 and 



3.4.2 



Here we introduce another quite exotic- looking transformation [2J: S : pij — > N pi 



2 

ij 

with the normalization factor N = 1/ pf^ so S simply squares the matrix elements. This 
transformation can be realized using basic steps involving feedback; we will restrict ourselves 
to qubits here. Assume we have two identical copies of the same state p m and consider the 
spins (qubits) pairwise: p m — > p m cg> p m . Now apply the well-known XOR-gate to the pair 
which is 

XOR 12 \i) x \j) 2 = |z)i|i© j) 2 i e {0,1} 

where © means addition mod 2. The third and last step is easy again, however, this is the 
key to the nonlinearity: measure the spin of the second qubit along the z-axis and keep the 
pair only if the result is "down". The whole transformation can be written in a compact 
form: 

(1 ® P (HW(p m ® p m )^ XOR )l <g> P ) = p out ® P (63) 

where Po = |0)(0|. It can be easily checked that = (p™) 2 indeed. The fact that S does 
not preserve the trace means that, with some finite probability, the transformation can fail. 
The procedure can be thought as a feedback process because it consists a filtering, based on 
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a (projective) measurement record. There are possible generalizations of S. For example, 
instead of qubits, we can use arbitrary dimensional Hilbcrt spaces (with the generalized XOR 
gate introduced in [Tj). 

This strong feedback based, nonlinear transformation can be used to optimally distinguish 
between nonorthogonal states or to purify mixed states. As an example of the latter, let us 
consider a qubit pair with density matrix p. After we squared the density matrix elements 
with S, we apply U ®U U G SU(2) (a rotation in the Hilbert space) with the parametrization 



U 



cosx 



sin xe 



-i<p 



smxe 
cosx 



up 



(64) 



and let us choose x = it/A ip = tt/2. One step of the whole dynamics becomes then 

T\p) = U(Sp)U^ (65) 

The goal is to use this transformation to restore one of the Bell states which has been 
perturbed (due to decoherence, for example). Define the state as 
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(66) 



and assume that our initial state is 



Ppert 



\ 



0.17 
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0.29 








0.205 


0.22 














0.31 



/ 



(67) 



which has a fidelity F = Tr{p\^+) ■ p per t) = 0.5075 with the original state. Figure|5j is a 
plot of the fidelities at every iteration step. One can see that after even number of iterations 
the state converges to the target. This happens because is the part of the stable cycle 
the map. The length of this stable cycle is two, the other member being a state orthogonal 
to |^/ + ). The procedure also generates entanglement in this case. 

Where is the connection between this protocol and chaos? This question was raised in 
and further analyzed in [2H1 EH] ■ Let us go back to the one qubit case (the transformation 
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Figure 5: Numerical simulation of the state purification using the map T iteratively. The 
initial fidelity is Fq = 0.5075. After f» 20 steps, the iteration converges to the stable cycle 
|$ + }}. Note, that the convergence is not neccesserily monotonic: after the second 
iteration we have F = 0.5025. 



is still J-, defined in (65)). Let us choose the initial state to be a pure state which we can 



write in the Riemann representation as 

|V>)= JV(z|0) + |l)) N = {1 + \z\ 2 )- 1/2 zgCUooeC 

where C is known as the Riemann sphere. It is straightforward to show that T transforms 
a pure state into a pure state and the parameter z transforms as 

z -> FJz) = Z +P n p = tan x ■ e itp (68) 
p 1 - p*z 2 

What we obtained is a nonlinear map on the Riemann sphere with one complex parameter 
p. These maps have been studied in detail since the beginning of the 20th century by Fatou, 
who studied particularly the map z — > z 2 / (z 2 + 2) [12J and later on by G. Julia and B. 
Mandelbrot, just to name a few who contributed to the subject. They showed that even 
the simplest nonlinear maps on complex numbers can show extremely rich structures. For 
example, the famous Mandelbrot set emerges from the rather simple-looking map z — > z 2 +p. 

F p (z) is a quadratic rational map, thus its Julia set - the set of irregular points - is 
non-vacous (for a rigorous treatment of dynamics of complex maps, see [36]). This is a 
usual definition for complex-valued maps to be considered chaotic. For example, consider 
the case with p = so F p (z) = z 2 . The Julia set is trivial in this case: the unit circle. 
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With a definition analogous to (43) we can calculate the Lyapunov exponent and find that 
it is a positive value (30]. In this sense, we can conclude that our projective measurement- 
based feedback protocol, if applied iteratively, can lead to true chaos in the mathematical 
sense. Figure [6] shows the rich structure of the Julia set, using reproduced simulations. 
The program iterates the map F p (z) for a given parameter p and calculates the number of 
steps needed to reach the stable cycle for different initial states. One can observe the fractal- 
like structure which is a usual property of chaotic systems; it shows that the convergence 
properties can change on arbitrarily small scales. 

One could also iterate mixed states and see that the purity follows irregular dynamics. 
The two qubit case is much more complicated to treat analytically, as the initial state space 
and the parameter space are considerably larger but in a suitable representation one find 
chaotic behaviour in entanglement as well [3l] . 

The following table summarizes some charateristics of the aforementioned proposals for 



feedback-induced chaos in quantum systems (see also Section 3.3 
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Figure 6: The Julia set for p — 1. Red means fastest, green means slowest convergence to 
the stable cycle (which can be proven to be the only stable cycle). In the blue domains the 
iteration does not converge under the criteria of the program 
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4 Conclusion and outreach 



In this paper, some paradigms for quantum feedback control were reviewed. As quantum 
feedback control has been a rapidly growing research area at least for two decades now and 
therefore is a huge field with extensive literature, the goal was not to survey it as a whole. 
Rather, to give a fairly self-contained description of selected tasks which can be efficiently 
done using quantum feedback and to treat them in a consistent formalism. Where it was 
relevant, comparisons to other control designs were made and we can conclude that for 
many problems, quantum feedback provides optimal results. However, some of these results 
do not take into account the delays which are inevitably present in an experimental setup. 
With practical considerations, it is possible that quantum feedback, at least measurement- 
based quantum feedback loses its superiority against conventional methods. This is part 
of the reason why the field of coherent feedback networks and control is coming into the 
focus (for a survey see [53]). We can also conclude that quantum feedback is linked to 
fundamental theoretical questions and can institute novel forms of quantum chaos. In fact, 
in order to have a satisfactory (and practically relevant) quantum mechanical description of 
the system dynamics, we need the evolution of systems which are being measured. Therefore 
the evolution of states is naturally conditioned on measurement results in any experimental 
setup which gives more understanding in the quantum - classical correspondence. 
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